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Field of the Invention 

This invention concerns? an ar*rang«rn«nt snrl a method, 
for controlling an electronic device starting from image a 
of a base. The invention also concerns an input unit fox 
inputting images from a base. 
Background of the Invention 

The Applicant's Patent Publication No, WO98/20446 
ciiecloses a reading pen which can be used for recording 
text by imaging this from a base. The reading pen has an 


optical sensor which records a number of images, wiLli ^ 
partially overlapping contents, of the text""~which'--±'e"'to 
be recorded. In addition, the reading pen has a processor 
which puts together the images, identifies the text in 
the images and stores it in character-coded format. The 
t.pyt can then be transferred to a computer with which the 
reading pen communicates. 

in addition, the Applicant's Patent Publication Wo, 
WO99/60469 discloaes an optical mouse which is arranged 
to pooition a cursor on a display of a computer. 

The readinq pen and the optical mouse are two exam- 
ples at input units whinh nan b<=> used to input informa- 
tion into a computer and jbo„control the function of a 


coi'upuLtii .r^AiioLhex- example of an input unit is a keyboard. 


trol the computer by means of various keyboard commando • 
A user does not want to have to change between dif- 
ferent input units in order to be able to carry out dif- 



which can be used both to flnf.pr information and to con- 
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ferent functions. Tlieieluitd it la a yenexal requirement 
chat each input unit ifi no b« ah'lo he used tor as many 
different functions as pooeible ajid in cxo flexible and 
simple a way as possible for Lhe unex - 

US Patent No. 5,932,864 rii acA orrr an arrangprnent 
for accessing electronic information via printed matter. 
More specifically, the arrangement couipiibtib an input 
unit which via a keypad is sw/tchable her.ween a Rnannpr 
mode and a mouse mode. In th£ scanner mode, a ucer can 
input an image of a dediuaLyfed uLjeyL on Lhe base, more 
specifically a bar code, a/ character or a symbol* The 
image is transferred from/ the input unit to a computer, 
which decodes the image /and which, as a result, executes 
a preprogrammed commandc, for instance to obtain inter- 
active software from am external database and executing 
this software on the /computer , During eAecuLiun, the uaer 
can, by operating ttte keypad, change the input unit to 
the mouse mode in cirder to interact with the software on 
a display. / 

A problem of inputting this type of dedicated 
objects is that the object must in many cases be accom- 
panied by some sort of explanatory text, so that the usei 
can understand which command Is initiated by the object. 
Tn Rpanlnu.g order catalogues this can usually be provid- 
ed, but in many other cacee the cpacc ia more restricted. 
Therefore the user uuxy have Lu learn lu what each oblect 
relates, which however reduces the usability of the 
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arrangement if it is to be generalised beyuud a certain 
application, such as programmi ng a t-.p.l Rviflinn Bet. 
Summary of the Invention 

An object of this invention is to dddiLiuiidlly 
improve prior-art input unxts. More speritinal ly it in 
an objeat to provide a general and flexible technique for 
controlling an electronic device. The provided Lecjluiinue 
should be intuitive to the user. t ~— — — 

This object is achieved by an arrangement according 
to claim 1 and a method accordin9 Lu victim 22 . The depen- 
dent claims define preferred embodiments . 

According to a first aspect, this invention concerne 
an arrangement for controlling an electronic device, said 
arrangement comprising an input unit with an optical sen- 
sor for recording images, and a signal -processing unit 
for identifying predetermined information in aL le<aLt*L une 
of said images and for controlling the electronic device 
dependent upon the predetermined information. The input 
unit io arranged, in a firBt function mode/ to convert 
at least onejLmage to a current text string containing a 
Kftrpi«fic!^ of characters> v and the signal -processing unit is 
arran^d^^ontrol the electronic device on the basis of 
the uuiienL Le*-L string. 

According to tbp* invention the arrangement for con- 
trolling an electronic device ie baced on an input unit 
function known per se, thaL its iticuidiiiy of text, which, 
however, is modified by making the signal -processing unit 
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control the electronic device on Llie baaiy ol Lhe current 
text string chat is recortie.rS . A nfiRr nan thus control the 
electronic device on the baeie of text which ic read 
using the input unit. This is a great advantage since Llie 
command indication can be printed or written in more or 
less clear text on a. base, whereby the control of the 
electronic device takes place in a way that is transpct- 
renc and intuitive to the user. Moreover, such r.ftvr.-basRrt 
command indications can be incorporated into a running 
text, without affecting the lay-out of the texL . In <->xdex 
to facilitate the user's identification of commands, 
these may, however, be marked somehow, for instance by 
using a divergent font/ a divergent color, underlining 
etc. 

The inputting of text into the inventive arrange- 
ment can advantageously be accomplished in the same way 
as in the Applicant's above-mentioned patent publication, 
although other accomplishments within the. scope of prior 
art arc also feasible. The optical sensor can be a line 
sensor, but is advantageously an area Bensor. 

The signal-procRRRing unit is preferably accomplish- 
ed ac software. However, it may consist of a specially 
adapted hardware uixuuiL, fox* instance an ASIC, an FPGA 
etc, or a suitable romHinati on of hard software and hard- 
ware . 



The tslfciuL-Luiiic: device controlled by means of Che 
arrangRmRnt nsn he* * computer, a mobile phone, a PDA, 
or a similar- electronic device. 

The command indication can coiiebpuud Lu e± couuciand 
to the electronic device at system or application 1 rvpI . 

The command can be, for instance, to emulate a keyboard 

^ ^_ _ ^ 

command. Alternatively, iL ueui ctluo be ^ special command, 
for example a u s e r - d e^Tnlprci " r.nmm a n ti ~ — —~ " 

Besides command indications in clear text, the clcc 
tronic deviue ucua dlfc>u be uunLrulled by Uej^L which is 
used in specific applications in the electronic device, 
such as addresses. The content of these addreccec varico, 
but the arrangement is suitably arranged to idexiLify Lhe 
format of the current text string and, starting from 
this, interpret to what the text string relates* By "for- 
mat" is meant the overall layout of the text sLiiny, uuuh 
as presence and location of one or more given characters 
or character combinations in a text string. 

The arrangement conveniently comprises a format 
database containing predetermined formats, to which the 
inputted text string is matched to determine whether a 
command is to be executed, and in that case which one. 
The arranqement advantaqeously also comprises a database 
editor which allows the user to introduce formats and 
associated commando into the format database. It is par- 
ticularly pielexied lux' these commands to initiate execu- 
tion of software on the electronic device. Ot course. 
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such <±ii editable database may also comprise a set of 
regular text RtringR (cornmand indications) which are 
matched in their entirety to the recorded text and which 
are each associated with a command. 

The use of a format database mftans that hhp arrange- 
ment, which with the input unit in its first function 
mode is arranged to inpuL LexL, u-uuipriaetJ an intelligent 
filter which interprets? the inputtRH t-.«xt: in order to 
identify commands therein. The filter is intelligent to 
such an extent that it does noL neotttitsciiily require iden- 
tical correspondence between the inputted text string and 
a text string in eaid database in order to identify a 
command. The use of such an intelligent filLei ylvew 
several advantages. When necesslSyT^the arrangement, wii-.h 
the input unit in one and the same function mods, can be 
used both to input text into the electronic device «nid Lu 
control the same. Moreover, the electronic device can be 
controlled, using at least part of the current text 
string, as will be described in moire detail below. 

in a particularly preferred embodiment, the text 
fit-ring nnmpri geg an address. The format database thus 
comprises predetermined formats for different types of 
ciddressefiS/ and the siqnal -processing unit is arranged to 
•iriemti -Fy an address in the current text string and cause 
the electronic device to directly or indirectly connect 
to the address . 


In a particularly preferred euibudimeiiL , the eicjnal- 
processing unit is arranged to cause, when i r3«nti tymg 
an address for electronic mail in the recorded text, the 
electronic device to open a program for electronic mail. 
Preferably, the arrangement: causes che device not only to 
open the program but also to open a template for electro 
nic mail- It ia still more preferred that the template its 
opened with the recorded e-mail address entered in the 
arid-ress field. It is also conceivable that the input unit 
is connected to the message field of the template, so 
Lhat the input unit: can be used to Input message text, 
tor instance by scanning of text or inputting of text, 
if the input unit has such a. function mode. 

The identification of an e-mail address format can 
take p.lace*, for e/xr^mpl f=> , by rprngni t ion of the at sirjn 
(@) , the signal processing unit interpreting all charac- 
Leib whiuh are associated with the at siqn as part of the 
address . 

Furthermore the oignal processing unit can advanta- 
yeuutsly be arranged Lo cause, when identifying a web 
address in the recorded text, the ftlfirtrnnin device to 
open a web browser. Preferably, the device is caused not 
only to open the browser, buL etltsu Lhe web paqe corre- 
sponding to the web address. The* signal -processing unit's 
identification of a web address format can, for example, 
be baaed on recognition of the character combination 
M hLLp:// n ux "www", the signal -processinq unit interpret - 
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ing all characters which, are associated with said chc±i<ic- 
Ler combination as part of the web address- in this way, 
the user can easily and quickly open a web page by using 
the same input unit as he or* she uses for other input 
functions . 

The signal -process ing unit can also advantageously 
be arranged to cause, when identifying a phone number 
in Lhe recorded LeitL , the electronic device to call the 
phonR TUimV^RT- . 

The arrangement according to the invention is easy 
Lo use for the user who need only move the input unit 
over text or place it on tesct in order to control the 
electronic device . The text can be self explanatory, 
which means that the arranqement will be intuitive to the 
user. The arrangement. 1s also general ^nri flRxihle, in 
that the electronic device can be controlled on the basis 
uL Lhti faiuuiL of an inputted text strincj, and by usinq at 
least part, of the hnxt stri ng . 

The arrangement can also eacily be combined with 
other inpuL unit fuxiuLioiia which dre baaed on recordinq 
of images by means of an optical sensor . 

Xn an advantageous embodiment, the arrangement also 
comprises an optical mouse function fux «juiiLx<jlliiiy a 
cursor on a display of the electronic device. Th« hrpit 
nan th^n carry out mouse functions using the arrangement 
and also control the electronic device by recording text . 
The mouse function it> eulvctiiLciyeuuyly integrated into the 


inpuL uiilL and rualized in the same way as in the Appll- 
canr ahnvp.-mp.nt.innflri ratp.nt pnhlication, Other realiza- 
tions within the ecope of prior-art technique arc, how 
ever, also possible « 

As mentioned above, the signal -processing unit", r.an 
generate a predetermined command when recognizing one or 
more predetermined characters or words in Llie iwcuxdad 
text. The predetermined words can simply he designar.innfi 
of the commands that are generated. To this end, the 
arrangement may advantageously comprise a pxoduuL on 
which a plurality of command indications are stated. The 
command indications can advantageously be indicated by 
character combinations which are easy for the user to 
understand. The product can be, for example, a mouse pad. 

In another advantageous embodiment, the arrangement 
comprises, alternatively or additionally, a handwriting/ 
handdrawing function for inputting of handwritten infor- 
mation into the electronic device. The handwriting/hand - 
drawing function is advantageously integrated into the 
input unit and realized in the same way as in the Appli- 
mtH-.'r Patent-. Publication WO99/G0467. Other realizations 
within the scope of prior-art technique are, however, 
also possible. 

Tn one embodiment, the signal -processing unit is at 
least partially located in the came cacing ac the elec 
tronic device. As a result, the inpuL unit ecsui be made 
simpler and cheaper. In addition, the processor capacity 


which is already available in Lhe electronic device can 
be used CO carry out: the fnnr.r.innR ot the eignal-proceee- 
ing unit. Certain processing of the recorded text can, 
however, advantageously be carried uuL in Lhe input unit, 
for example localization of the text in th« image or 
imagGS and conversion of the text to character coded 
format, for example ASCII code, so that <± uuialler amount: 
ol ixilormation needs to be transmitted from th<=* -input 
unit to the electronic device. 

In another embodiment Lhe tiiyiictl-pxucessinq unit can 
be completely integrated with the input unit so that thp 
electronic device receives one or more commando directly 
from the input -unit. In another embodiment the input uniL 
can ^ust record images and transfer these to the aigna I - 
prnnpflsing unit which carries out all the processing of 
the images - 

The input unit can be arranged to communicate with 
fchfi p»1 p.ntronic device by wireless means, so that the use 
of the input unit is as flexible as possible and so that 
ueilaixi functions can be used stand-alone* Alternatively, 
communication via a cable could be possible, for example 
via a USB. 

Accordiny Lu one more embodiment, the input unit 
functions In the tirfih function mode as a handheld text 
scanner and the signal-processing unit ic arranged to 
continually interpret the text contenL of Lhe images 
xetjuxded by the optical sensor. To prevent words which 
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are only intended to be inputted euid slured ±n the elec- 
tronic device, but: which consist of the same character 
combination as a command indication, from being inter 
preted ae a command, it is possible to place addiLiuiicil 
demands on what: the signal -processing unit is t-.o intRr- 
pret as commands. For instance , it may be required that 
command indications consist of characters in tipwuicil 
Tone, special size, printed in capital letters, iant1<=rr- 
lined, printed in extra bold type or in italics etc. 

Alternatively, the arrangement is designed in audi 
manner that it can selectively be caused to operate in 
a control function mode, in which the signal -processing 
unit is arranged to control the electronic device on the 
basis of the current text string. The embodiment has the 
advantage that it simplifies the arrangement since it 
just has to interpret text in the control function mode. 
The risk that text which is only Intended to be inputted 
And stored in the electronic device is erroneously inter- 
preted ac a command io aloo eliminated. 

An input unit with a plurality of function modes is 
in one embodiment arranged to automatically select the 
function mode on the basis of the content of one or more 
images, i.e. by identity iny some kind of predetermined 
information. The pTeri«t«rnn npd information can in prin- 
ciple be any information which makes it possible for the 
input unit to interpret that it is to change Ixutu u cur- 
xexit function mode to a new function mode. The informa- 
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tion can, for example, consist of one ux mox*e predeter- 
mined characters, symbols, words, next-, in special tont 
or line thickness or the like. When the input unit idcn 
tifics the predetermined information, it autonictLit;<±lly 
chanqes to the required function mode. In this way th« 
user does not need to press any buttons, 

In a preferred embodiment/ the predetermined infoi- 
uic±Liun is a predetermined pattern. If the input un.1r., fnr 
Rx^mple, has a mouse function mode and a control function 
mode, it can be programmed to be able to idenLify Llie 
pcLLLex*n on a mouse pad. when the user places the input 
unit nn the mouse pad, it records an image of the pattern 
on the mouoc pad. The input unit identifies the pattern 
as predetermined information which indicates mouse func- 
tion and it nhangflR automat ically to mouse function mode 
and proccooco the images to achieve the mouse function. 

It is, of uuuibti, LJuiivenieiiL if the input unit is 
also arranged to change* from the movise function mode to 
the control function mode whon it detects other predeter- 
mined iiifoiuiciLioii. if Lhe input unit has only a mouse 
function mode and a control function mnrift, it can, for 
example, change back from the mouoc function mode to the 
control function mode when it deLeuLu LhaL Lhe predeter- 
mined pattern for the mouse function moriR is no longer 
prftRpnt in the captured images. Alternatively, the change 
can be carried out on the basis of positive i dent if iueL- 
tion of a cjtiiLciiii piece of predetermined information. 


This automatic change be L ween different function 
utudes can, of course, toe usee* .1 nrifap^nrlent iy of how many 
and which function modes the input unit comprises. As 
mentioned above, the input unit may, fox e^ctiiiple , com- 
prise a control function mode/ a text inputting mode 
(scanner function mode) , a mouse function mode and a 
handwriting recording mode. 

The input unit may also comprise a phor.ng-raphing 
mndR, in which it can be caused, like a camera, to record 
and store single images . 

in an advantageous embodiment, the predetermined 
infnrmatinn consists ot a position-coding pattern, pre- 
ferably an aboolutc position- coding pattern. 

The advantage of a position- coding pattern is that 
the predetermined Information can consist of one or more 
specific pooitions . This makes it easier for the device 
to identify when it la Lo change, as it does not need to 
carry out any charsntRr -recognition (OCR) . 

Absolute position-coding patterns are known, for 
example, Iiuiu us 5,652,434 and the Applicant's patent 
Publication WODO/73983 which was not p\iblicly available 
at the time of the filing the Swedish patent application 
from which the present appliueiLiuii claims priority. 

According to a second aspect, thR present invention 
relatf»R to a method for concrolling an electronic device, 
comprising the steps of operating a handheld input unit 
to recuid dL least one image, identifying predetermined 


information in said at least one image, ami controlling 
Lhe electronic device dependent: upon said prRfletermin- 
Rd -information. In this method, said at least one image 
ic converted to a current text string which comprises 
*± sequence of characters, and the electronic device is 
nnntro J led on the basis of the current text string. 

The advantages of this method are evident from the 
above discussion of the arrangement. The features of r/he 
arrangftnifint are, where appropriate, applicable also to 
the method. 

Thtes Applicant's Patent Publication WO99/60468 dis- 
ci ose.s an input unit which has an imagG-based mouse func- 
tion mode and an image baaed input function mode. The 
inpuL unit is chanqed by the user pressing buttons. 

A further object is to gene-rally Rimpl ify the use 
of an input unit which hac two function modes, so that 
the change between -different* fuiicLiuii modes can be car- 
ried out in a way that 1r smooth for the user. This object 
is achieved by an input unit according to claim 28. The 
dependent claims define pieltsrred embodiments . 

More specifically, the invention comprise** anrnrding 
to a third aspect an input unit which hac at least a first 
and a second function mode. The input uniL comprises a 
detector for capturing of images, tor instanr.ft an optical 
sensor, and an im^ge processing device, for instance a 
proceccor, for processing the images to achieve said two 
function modes. The iiipuL unit is arranged to change from 
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the firBt to the second function uiude when the image pro- 
ueasor detects a first: piece of prp.rlfitermined information 
in one of said images . 

Like in the arrangement for controlling c±u electronic 
device/ the predetermined information can .in principle be 
any intormation which makes it possible for the input unit 
to interpret that it is to change from a cuxxent function 
mode Lu c± xxew function mode. The informar.inn nan, tor 
example., nnnnigt of one or more predetermined characters, 
symbol o, words, text in special font or line thickness or 
the like, when the input unit identifies the predetermin- 
ed infnrmatinn, it automatically changes to the required 
function mode. In this way, the user does not need Lu 
piwbb any buttons. 

In a pre t erred RmbnHi ment , the predetermined infor- 
mation ic a predetermined pattern. If the input uniL, £ox" 
example, has a uiuutie function mode and another function 
mode, it can be programmed to be able to identity the pat- 
tern on a mouse pad. When the user places the input unit 
on the mouse peid, the detector records an image of the 
pattern on the mouse pad. The=» im^ge processor identifies 
the pattern as predetermined information which indicates 
mouse function and it then cheuiyeti automatically to the 
mouse function mode and processes th« images to achieve 
the mmiFifi function. 

Of course, it is convenient for Lliti input unit also 
to be arraiicjcd to change from the second function mode to 


the first function mode when it deLeuLa a second piece of 
predetermined information, if the input unit just has a 
mouse function mode and an input function mode, it can, 
for c^tamplc, change back from the mouse function mode Lo 
the input function mode when the image processor det«r.tn 
that the predetermined pattern for the mouoe function mode 
io no longer present in the recorded images. A1l«xia«i Live- 
ly, the change can take place on the basis of ponitlve 
i riRnti float ion of another predetermined pattern. 

In an advantageous embodiment, the predate a mined 

]| information consists of a position-coding pattern, pre- 

ffvrsbly an absolute position-coding pattern- The advan- 

.p tagc of thio is evident from the above discussion of the 

I irl 

jfj arranqement for controlling an electronic device. 

*~ The fuTintinnfl between which the change takes place 

W can, for example, be a mouse function mode, a scanner 

q fuiiuLloxi mode, a handwritinq recording mode, a photo- 

jt graphing mode* nr some similar function mode which can 

^ be achieved on the baoio of captured images . 

Bjiier DeacriuLio n of the Drawings 

This invention wi I I now b^ described in greater 

detail by meazic of an embodiment with reference to the 

accompanying drawings, in whiuh 

Kig. 1 schematically i 1 1 uRtvra1-.es the composition and 

use of an arrangement according to the invention, and 
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Fig. 2 ic a oimplif icd flow chart showing opexctLioxis 
which are carried ouL in an arrangement, similar co r.h« 
one in Fig. 1 . 

Description of a Preferred Embodiment 

An emliudiiuenL of an arrangement: is described below 
which compri se.R a mnn.se t unction mode, a scanner or read- 
ing pen f \inc t ion mode and a control function mode which 
is based on text recordinn . 

Kig. 1 shows a mousa pad ion, an electronic device 
2 00 in the form of u computer and an input unit 3 00 for 
the computer , 

The mouse pad 1 UO tias a working field 110 with an 
irregular pattern (not shown) which makco it possible to 
determine the relative yowl Lions of two images which have 
partially overlapping contents by mp.anR n-F the contents 
of the images, and a command field 12 0/ in which a number 
of predetermined command iiidicaLiuxia axe stated. 

The input unit 3 00 has a casing 1 in the shape of 
a pen. One short side of the casing 1 haa a. window 2 
through which images are ecip Lured for the different 
imaqe-based function modes of the input unit 3<in. 

The casing 1 contains principally an optics part, 
an electronics part and a power supply . 

The optics part comprises a number nf light emitting 
diodes 6, a Irtir sypit-.pm 7 and an optical sensor 8 which 
constitutes the interface with the electronics part. The 
light emitting diodes 6 dxu iiiLexided to illuminate a sur- 


face ul Llie base which is at che moment below the window. 
The 1«rtR fly.gtem 7 is intended to project an image of the 
surface whiah io below the window 2 onto the liyliL-sexisi- 
tive sensor 8 in cts correct: a way as possible. The. npti - 
cal sensor 8 can ronsi nt of an area sensor, such as a 
CMOS Bene or or o CCD sensor with a built-in A/D trans- 
ducer . Such fcffcsiiaora are commercially available. 

in this Rvample, the power supply for the input unit 
is obtained from a battery 12 but can alternatively be 
obtained from a maixis connection (nor shown) . 

The electronics part compriflftfi « processor 20 with 
conventional associated circuits, such as various types 
of memory, and associated pxuyiams lor carrying out the 
functions described here. Thp. r! p.ctronics part also com- 
prises a transceiver 2 6 for trancmitting information to/ 
from the computer 200. The Lidxwueiver 26 can be based on 
infrared technology, ultrasonics or radio technology for 
transmission over short dietancee, for example in accor- 
dance with the Bluetooth standard. The wleutronics pare 
further comprises buttons 27, by means nf which the user 
nan control the input unit 3 00 and in particular change 
the input unit between the mouse f uiieLiun mode, the scan- 
ner Tunc Lion mode and the control function mode. When th« 
input unit 300 operates in the mouse function mode, the 
buttons 2 7 can alco have functions which correspond to 
the click buLLunti on a traditional mouse. 
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Tliti computer 2 00 Is an ordinary personal computer 
with r.irnntR and programs which make possible communi 
cation with the input unit 300 . However, in thio embodi- 
ment this also contains a siqiuil -processing -unit which 
constitutes part ot the arrangpment for controlling its 
function. The aignal processing unit consists in this 
example of a pioyidiu which is installed in the computer 
200. This is shown symbol ins My hy broJcen lines and refe- 
rence numeral 210. 

As mentioned, the input- unit 3 00 has a scanner func- 
tion mode, a mouse function mode and a control function 
mode . 

The scanner function mode is uatid Lo record text. 
The user passes the input unit 3 00 across th« t-.R-vt which 
hf=>. Tit to record. The optical sensor 8 recorde imagco 
with partially overlapping contents. The iiticiyea are put 
toqether by the processor 20. hach character in the puh- 
together image is localised and, using for example neural 
network software in the processor 20, its correto*puiuIiiiy 
ASCII characters are determined. The text converted In 
this way to charar.hp.r-nnrip.d format can be stored, in the 
form of a text otring, in the input unit 3 00 or transfex- 
red to the computer 200. The scanner function is describ- 
ed m greater r3«i-.»il in the Applicant's Patent Publi- 
cation KTo . WO98/20446 , which ic incorporated herein by 
reference . 


The mouse function mode is used to control a cursor 
on r.hp. display 9.Q1. ot the computer 200. The mouse func- 
tion mode ic alco image based in this embodiment. When 
the input uiiiL 3 00 is moved across the working field 110, 
the opti r.al RP.nRnr R -records a plurality of images with 
partially overlapping images. The processor 20 determines 
positioniiiy aiyiidlB for the cursor of the computer 200 on 
the basis of r.ha rp.1at-.ivR pnRitinng ot the recorded 
images, which are determined by mcano of the contents of 
the iuiciHes. The mouse function is described in greater 
detail in the Applicant's P^hp.nt Publication No. 
WO99/60469, which io incorporated herein by reference.. 

The control function mode is bdt>t=;Q on the scanner 
function. The user records text in th« mitip way as in the 
scanner function mode. The text ic cent in character 
coded format fxoiti the input unit's 300 transceiver 26 to 
the signal -processing unit 210 in the nompnhP.r 500, toge- 
ther with an indication that thic ic control information 
which is to be interpreted. The signal -pruuetiuiiiy unit 
210 examines the received text and searches tor p -redeter- 
mined information in this in the form of predetermined 
characters and character combinatioiits . When such pre- 
determined information is found, the signal -processi rig 
unit 210 creates predetermined commands to the computer 
200 as a function of the predetermined information. 

The aij-<Aiayfc!meiiL described above is used in the fol- 
lowing way. Kirst assume that the user wants to nne the 
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input uniL 300 eta ci mouse. Ke selects Che mouse function 
mode by means* of thP. h\ittons 27. By moving the input unit 
3 00 on the working field 110 he controls the cursor on 
the display 201 of Llie eumpuler 200. Assume nexc Chat the 
user edits a document in hhp. nnmpnter 200. He can then 
mark text by "clicking" with the buttons 27 and posi- 
tioning the cursor- Assume LheiL Lhe user lirst wants to 
replace a first piece of text with « second piece of text 
which is situated elsewhere in the text- The user presses 
one of the but Lorn* 2 7 ctnd ptibaea the input unit 3 00 
across the second piece of text to marJ< the samR. Th^n he 
changes the input unit 300 to the control function mode 
and records the command indication "cut" by pctBtiixiy the 
input unit 30U across this command indication nn th** com- 
mand field 120 of the mouse pad 100. The input unit 300 
then sends the character-coded LcaL "uuL " Lo the siqnal- 
processlng unit 210 in the computer 200, which ident.it i^.fi 
the text as a command indication and creates a corre- 
sponding command for the word processing application con- 
cerned, which cuts out the marked piece of text. The user 
next nhnngRR the input unit 3 00 to the mouse function 
mode and marks the first piece of text using the iiipuL 
uniL 3 00 ciiid then causes the computer 3 00 to paste the 
cut-out piR.n« of tRYt in place of the marked text by 
changing the input unit 3 00 to the control function mode 
and recording the command iiidiudLiuii "paste" usincj the 
input unit 300, 


Now assume thai the user wants to enter text from a 
newspaper in his rtomimfinr.. He tirst positions the cursor 
in the required place uoing the input unit 3 00 changed to 
the mouse function mode. Then lie chcinyes the input unit 
3UU CO the scanner function mode* anri rcistis the text from 
the newspaper. The text ie converted into character-coded 
format and transmitted to the siyiiei.1 -prucesaixiq unit 210 
which causes the computer ano to insert the text in the 
position marked by the cursor. 

Now assume thaL the uaex- tsees an interesting web 
address in the newspaper he is reading and wants to InnV 
at this web page. He then changes the input unit 3 00 to 
control function mode and reads off the web dddress from 
the newspaper. The recorded text j s? tranflfprrftH to the 
signal -processing unit 210 which identifies the character 
combination "http://" and causes the uumpuler 200 to open 
the web page with the recorded address. 

Finally, assume that the user wants to cend an 
e-mail to a friend. He uses the input unit 3 00 chanyed 
to the control function mode to record the command indi- 
cation "p.-nianV 1 on the mouse pad 100. The recognition of 
thio command indication by the signal -processiny unit 210 
resulLa in the unit Generating a command to the computer 
200 which c!rniR*=».e it to open the e-mail program. The user 
can then record the required e-mail address and even the 
content of the mess dye usiny Llie scanner function. 


As shown above, the user can conveniently carry out 
a number of different functions which compricc inputting 
in forma Li on and conLxulliiiy Lhe uuuipuLux 2 00 by uiecuit* of 
jnflt oriR input unit M(H)_ 

Of course, other functions can be integrated into 
Llie input- uxiiL 3 00 in order to further increase its 
usability. An example is a function to record handwritten 
text, which ic deccribed in the Applicant 1 © Patent Publi- 
cation No. WO99/6 0467, which is incorporated herein by 
reference . 

Another example is a photographing mode, in which 
the input unit 30 0 via the buttons 2 7 can be caused to 
record single images and store these and/or transfer 
these to the computer 200. The lens system must be chang- 
ed so that a sharp image on the sensor Q is obtained at 
an infinite distance, or normally a distance of about two 
meters. In the scanner function mode and the mouse func- 
tion mode, however, the lens system 7 is adjusted so that 
a sharp image is obtained of an object which is position- 
ed at the window 2 , i.e. normally about two centimeters 
from the sensor 8 . 

Moreover, other commands than those stated above can 
be generated. A urrt m^y also himsRl f ri f i n p> how "recorded 
text io to be interpreted by the signal processing unit 
200 and which COiiL j. ol of the uumpuLcx 200 <x ueiLdin 
recorded text is to result m. 


Tt ha« hp.fin described above chat the change between 
the different function modee takes place by the user 
preatsiny the buttons 27 on the input unit 300. As an 
alternative, the input unit 300 can itself detect that 
it is to change between different function modes. 

Fiy. 2 illustrates schematically a flow chart of the 
operations in such an alternative arrangement. The input 
unit 3 00 is arranged to search for predetermined infor- 
mation in each image recorded with the optical acnoor S 
(step 4 01) . The predetermined information can be, for 
example, the pattern on the worlcing f-i<=»1d 110 nf hhp. 
mouse pad 100. If the processor 20 detects this pattern, 
it changes to the mouse function mode (step 4 02) and pro- 
cesses the images in the manner descri beri flhnvp r.n gp.np- 
ratc positioning oignalo to the curcor on the dieplay 201 
of the computer 200. II the user then places the input 
unit 300 on a np.wspape.r in order to scan text, the pro* 
ccssor 2 0 no longer dctccto the mouoo pad pattern and 
then knows that iL la Lu uheuiye Lu Lhe scanner function 
mnriR (Rt.p.p 4 03) and pror.RfiR the images in the manner 
deecribed above for identification of text and conversion 
Lliereuf Lu ct uhdidcLer-coded text stx-ing. The text string 
is then transmitted to the computer ^uu (step 4U4) , in 

which the Bignal -processing unit 210 in this embodiment 
continuolly matches the received text strings to the con- 
tents of a database (step 405) « in case of correspon- 
rip.nr.F. , thp. si gna I -processing unit 210 generates a com- 


manci, r.orre.flponding to the text string, to the computer 
2 00 (step 4 06) , and otherwise, the text ie inputted, if 
pottBibltj , LO an application in the computer 20 0 (step 
407) . in r.his case, an automatic change between the scan- 
ner* function mode and the control function mode thus 
Lakes pla^e (sLep 4 05) by means of an intelligent filter. 
The intelligent filter in the signal -processing unit 210 
analyses the format of the received text string for iden- 
tification of control information. An e-mail address can, 
for example, be identified by the presence of an at sign, 
optionally in combination with its relationship with 
other given characters , and is interpreted as a command 
to open an e-mail program with the e-mail address entered 
in the address field. A web address can be identified by 
the presence of the character combination "http;//" or 
"www" , optionally in combination with its relationship 
with nthpr givRti rharanhfirs, anri is intftrprfthftri as a 
command to open a web reader with the indicated address. 
A file address can. Tor example, be identified on the 
>75ae?ijq of the oh 3 rs r.tRT nnmhi nati nn " : \ " i *n onmn i t\r t i on 
with a given finalising file type indicator (".doc", 
".tsjte", " . mp3 " , eLu . ) diid iuLeipi e Led a» c± cjonuuaiid lu 
open a file by means of the program indicated by the tile 
type indicator. 

According to an alternative, the input unit 3 00 is 
actively controlled to the control function mode by the 
user, hnwp.ver, without using buttons. The. rnrnmanri indins- 


t.ionR in the command field 120 of the mouse pad 100 in 
Fig- l can be written in a given manner, bo that the pro- 
C e bbU1 2 0 can detect that the inputted characters are not 
rharar.r.erfi r.hac are no be inputted into the computer 
according to the scanner function mode, but characters 
that repreyeaL a cuuuiicuid and are to be sent to the 
signal -processing unit ^1U to be processed as such. The 
command indications can be, for example , written in a 
special size, a special font or a special line thickness* 

As another example, the change to the scanner func- 
tion mode can be carried out on the basis of change com- 
mands which are written in the command field 12 0 of the 
mouse pad 100 . as is evident from Fig. 1. When the user, 
for instance, wants to change to the scanner function 
mode he records by means of the input unit 3 00 the word 
"scanner" from the command field 120 . The processor 20 
identifies this as predetermined information which indi- 
cates that it is now to carry out a scanner function. 
Correspondinqly, recordinq of the word "camera" from the 
command field 12 0 results in a change to the photograph- 
ing mode . 

The above description has been qiven with reference 
to a mouse pari and a computer. However, it will he appre- 
ciated that the arrangement io also uoablc in other 
cases, such as for controlling a mobile phone or a PDA. 
>*or instance, the input unit can be used to read, from 
a business card, a fav nnmhpr , a phnnp. number, an e-mail 


address oar a web addrPRR , on hhe. basis thereof, cause 

the mobile phone or the PDA to connect to one of these 
addresses, in this coxiLe*.L , iL will appreciated that the 
input unit and the si Qna "I -pror.ftfifii ng unit can be an inte- 
grated part of the mobile phone or the PDA. 

Revertinq to the mouse pad in Fiy. 1, it was stated 
abovp. that the pattern on the same is an irregular pat- 
tern and that the mouoe function ie achieved by determi- 
nation o£ the xeldLive positions of the recorded images. 
Tn annthpr Rmhnriimftnt, the pattern on the mouse pad 100 
can be a poeition-coding pattern, which systematically 
codes positions* over Lhe whole of the mouse pad 100. In 
this case the mouse function can be based on reading off 
pooitiono ucing the poeit ion-coding pattern. In addition 
the change to the mouse function mode can be based on 
recognition ot the position-coding pattern, in addition 
particular positions or position areas (also called 
dotuctiiifa- oj. x eg ions) , for example those corresponding to 
the different command indications in the command field 
12 0, can be dedicated to particular function modes. When 
the processor detects a particular position, it deter- 
mines which function corresponds to this position. In 
this way the input unit 3 00 can be caused to change from 
one function mode to another function mode by placing it 
in a particular position on the mouse pad. Different 
rp.gi nriR nf tbp. position-coding pattern can also be dedi- 
cated to commands for controlling the computer 200. 
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Tnfit-.ftari nt the. signal -processing unic in the computer 2 00 
detecting predetermined information in the text which is 
ciiLered, it can thus detect positions in the form of 
coordinates and identify which command is to be created 
to control the computer 200. For example, if the user 
wanLbi Lu open the e-mail program in the computer 200, 
he can place the input unit 3 00 on the mouse pad loo in 
a position where it says "e-mail". The optical sensor 8 
records an image of the position coding pattern in thio 
position. The processor 2 0 identifies which position, 
that is which coordinates, correspond to thft pofii ti on- 
coding pattern in the image. It sendB the coordinates to 
the signal -processinq unit 210 in the computer 200. The 
signal -processing unit 210 identifies that t-.hp.Rft rnnrrii - 
nates mean that it io to create a command to the computer 
200 which causes it to open the e-mail pruyxauu. In Lhiw 
case, tVip mRRRagp. "ft-mai I" is only an indication to the 
user to which command the field corrcopondo while the 
actual operation Lxlyyered by Lhe inpuL unit 300 is 
HRtp.rmiTip.d hy the. posi r.i on -coding pattern. The advantage 
of this arrangement is that the input unit need not sub- 
ject a LexL didrduLex xecuyiiiLion (OCR) , with the 
ensuing risJc of misinterpretation. 

The mouee pad can thus be divided into position 
areas or regions which are associated with different 
functions or commands. An additional example of this 
is that nnp. re.gion nan be dedicated to a relative mouse 
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function mode {t.Y\a r.nrsor is moved in the same way as the 
input unit) and another region to an absolute mouse func- 
tion mode (the curaur ia placed in the position which 
corresponds to the poR-ition of the input unit on the 
mouse pad) . The input unit itself understands which 
function it is to use un Lhe basis of whether the posi- 
tion -r.orii ng pattern (and hence the identified coordi- 
nates) bclongc to one or the other region. 

OI uuujL^e, alternatively the same surface can be 
used for f.h« relative and the absolute function mode and 
the change can be carried out by means of change commands 
ixi Lhe w<ay described above . 

A further example is that the mouse pad can have 
an area which is dedicated to a scrolling function. The 
input unit can thus be a mouse with various mouse func 
t.ions- It can also be a mouse which, in addition to con- 
trolling a cursor on a display, can control nthP.r func- 
tions of a computer or other electronic devicco, ouch ao 
a mobile telephone or a PDA. 

The above description is just one evampl p. of how the. 
arrangement according to the invention can be decigned. 
tJased on the summary of the Invention, experts in the 
field can achieve a nnmhRr of variants ot this example 
within the scope of the appended claimc . 
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